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Abstract  More  than  forty  years  ago.  Professor  Chua  predicted  the  existence  of  the 
memristor  to  complete  the  set  of  passive  devices  that  previously  includes  only  re¬ 
sistor,  capacitor,  and  inductor.  However,  till  2008  the  first  physical  realization  of 
memristors  was  demonstrated  by  HP  Lab.  The  unique  properties  of  memristor  create 
great  opportunities  in  future  system  design.  For  instance,  the  memristor  has  demon¬ 
strated  the  similar  function  as  synapse,  which  makes  it  promising  to  utilize  mem¬ 
ristor  in  neuromorphic  circuits  design.  However,  as  a  nano-scale  device,  the  process 
variation  control  in  the  manufacturing  of  memristors  is  very  difficult.  The  impact 
of  the  process  variations  on  a  neural  network  system  that  relies  on  the  continuous 
(analog)  states  of  the  memristor  could  be  significant  due  to  the  deviation  of  the 
memristor  state  from  the  designed  value.  So  a  complete  process  variation  analysis 
on  memristor  is  necessary  for  the  application  in  neural  network.  Due  to  the  different 
physical  mechanisms,  TiCH-based  memristor  and  spintronic  memristor  demonstrate 
very  different  electrical  characteristics  even  when  exposing  the  two  types  of  de¬ 
vices  to  the  same  excitations  and  under  the  same  process  variation  conditions.  In 
this  work,  the  impact  of  different  geometry  variations  on  the  electrical  properties 
of  these  two  different  types  of  memristors  was  evaluated  by  conducting  the  ana¬ 
lytic  modeling  analysis  and  Monte -Carlo  simulations.  A  simple  algorithm,  which  is 
based  on  the  latest  characterization  method  of  LER  (line  edge  roughness)  and  thick¬ 
ness  fluctuation  problems,  was  proposed  to  generate  a  large  volume  of  geometry 
variation-aware  three-dimensional  device  structures  for  Monte-Carlo  simulations. 
We  investigate  the  different  responses  of  the  static  and  memristive  parameters  of 
the  two  devices  and  analyze  its  implication  to  the  electrical  properties  of  the  mem¬ 
ristors.  Furthermore,  a  process-variation  aware  device  model  can  be  built  based  on 
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our  work.  Both  corner  model  and  statistical  model  can  be  provided  depending  on 
users’  requirements.  Our  device  models  make  it  possible  for  scientists  and  engineers 
to  design  neuromorphic  circuits  with  memristive  devices,  and  therefore,  to  convert 
virtual  neural  network  in  super  computer  to  the  real  hardware  memristive  system  in 
the  future.  Rather  than  the  existing  crossbar-based  neuron  network  designs,  we  fo¬ 
cus  on  memristor-based  synapse  and  the  corresponding  training  circuit  to  mimic  the 
real  biological  system.  The  basic  synapse  design  is  presented,  and  the  training  shar¬ 
ing  scheme  and  explore  design  implication  on  multi-synapse  neuron  system  have 
been  explored. 


1  Introduction 

In  1971,  Professor  Leon  Chua  predicted  the  existence  of  the  memristor  [1],  How¬ 
ever,  the  first  physical  realization  of  memristors  was  demonstrated  by  HP  Lab  very 
recently  in  2008,  in  which  the  memristive  effect  was  achieved  by  moving  the  dop¬ 
ing  front  along  a  TiOi  thin- film  device  [2],  Soon,  memristive  systems  on  spintronic 
devices  were  proposed  [3], 

The  unique  properties  of  memristors  create  great  opportunities  in  future  system 
design.  For  instance,  the  non-volatility  and  excellent  scalability  make  it  a  promis¬ 
ing  candidate  as  the  next-generation  high-performance  high-density  storage  tech¬ 
nology  [4] .  More  importantly,  memristors  have  an  intrinsic  and  remarkable  feature 
called  a  “pinched  hysteresis  loop”  in  the  i  —  v  plot,  that  is,  memristors  can  “remem¬ 
ber”  the  total  electric  charge  flowing  through  them  by  changing  their  resistances 
(memristances)  [5],  For  example,  the  applications  of  this  memristive  behavior  in 
electronic  neural  networks  have  been  extensively  studied  [6]  [7]. 

As  process  technology  shrinks  down  to  decananometer  (sub-50nm)  scale,  device 
parameter  fluctuations  incurred  by  process  variations  have  become  a  critical  issue 
affecting  the  electrical  characteristics  of  devices  [8],  The  situation  in  a  memristive 
system  could  be  even  worse  when  utilizing  the  analog  states  of  the  memristors  in  de¬ 
sign:  variations  of  device  parameters,  e.g.  the  instantaneous  memristance,  can  result 
in  the  shift  of  electrical  responses,  e.g.  current.  The  deviation  of  the  electrical  exci¬ 
tations  will  affect  memristance  because  the  total  charge  through  a  memristor  indeed 
is  the  historic  behavior  of  its  current  profile.  Previous  works  on  memristor  variation 
analysis  mainly  focused  on  its  impacts  on  non-volatile  memory  design  [4]  [9].  How¬ 
ever,  the  systematic  analysis  and  quantitative  evaluation  on  how  process  variations 
affect  the  memristive  behavior  still  needs  to  be  done.  Our  work  explores  the  impli¬ 
cations  of  the  device  parameters  of  memristors  to  the  circuit  design  by  taking  into 
account  the  impact  of  process  variations.  The  evaluations  were  conducted  based  on 
both  theoretical  analysis  and  Monte  Carlo  simulations. 

The  device  geometry  variations  significantly  influence  the  electrical  properties 
of  nano-devices  [10].  For  example,  the  random  uncertainties  in  lithography  and  pat¬ 
terning  processes  lead  to  the  random  deviation  of  line  edge  print-images  from  their 
ideal  pattern,  which  is  called  line  edge  roughness  (LER)  [11].  Thickness  fluctuation 
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(TF)  is  caused  by  deposition  processes  in  which  mounds  of  atoms  form  and  coarsen 
over  time.  As  technology  shrinks,  the  geometry  variations  do  not  decrease  accord¬ 
ingly.  In  this  work,  we  propose  an  algorithm  to  generate  a  large  volume  of  three- 
dimensional  memristor  structures  to  mimic  the  geometry  variations  for  Monte-Carlo 
simulations.  The  LER  model  is  based  on  the  latest  LER  characterization  method  for 
electron  beam  lithography  (EBL)  technology  from  top-down  scanning  electron  mi¬ 
croscope  (SEM)  measurement  [12], 

Some  previous  experimental  results  showed  that  the  geometry  variations  are  the 
dominate  fluctuation  source  as  process  technology  further  scales  down  [8].  There¬ 
fore,  we  mainly  focus  on  the  impacts  of  geometry  variations  in  this  work.  However, 
other  process  variations  such  as  random  discrete  doping  (RDD)  could  also  result 
in  the  fluctuations  of  the  electrical  properties  of  devices.  RDD  is  an  important  and 
complex  contributor  to  the  variation  in  MOSFET  and  other  nano-devices  since  tech¬ 
nology  node  becomes  90 nm  or  less.  Statistically,  RDD  is  independent  to  LER  and 
TF  [13]  [14],  the  study  of  RDD  on  memristor  is  a  good  complementary  portion  to 
this  work.  We  will  explore  it  in  the  future  work. 

Memristive  function  can  be  achieved  by  various  materials  and  device  structures. 
However,  the  impact  of  the  process  variations  on  the  electrical  properties  of  differ¬ 
ent  memristors  could  be  very  different  even  under  the  same  excitations.  Therefore, 
two  types  of  memristors,  TiCH-based  memristor  [3]  and  spintronic  memristor  [15], 
are  analyzed  and  evaluated  in  our  work.  These  two  examples  are  selected  because 
they  respectively  represent  two  important  mechanisms:  solid  state  and  magnetic. 
However,  our  proposed  modeling  methodologies  and  design  philosophies  are  not 
limited  by  the  specific  types  of  devices  and  can  be  easily  extended  to  the  other 
structures/materials  with  necessary  modifications. 

Our  contributions  can  be  summarized  as  follows: 

•  We  investigate  the  impacts  of  geometry  variations  on  the  electrical  properties  of 
memristors  and  explore  their  implications  to  circuit  design.  Monte  Carlo  simula¬ 
tions  are  conducted  for  quantitative  evaluations. 

•  An  algorithm  for  fast  generation  of  three-dimensional  memristor  structures  is 
proposed  to  mimic  the  geometry  variations  incurred  by  EBL  technology.  The 
generated  samples  are  used  for  Monte-Carlo  simulations. 

•  The  memristive  behavior  analysis  and  evaluations  of  both  TiC>2  -based  and  spin¬ 
tronic  memristors  are  presented. 

•  We  propose  a  single  memristor-based  synapse  structure  and  the  corresponding 
training  circuit  design  that  can  be  used  in  neuromorphic  computing  system.  The 
design  optimization  and  its  implementation  in  multi-synapse  systems  are  dis¬ 
cussed. 
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2  Preliminaries 
2.1  Memristor  Theory 

The  original  definition  of  the  memristor  is  derived  from  circuit  theory:  besides  re¬ 
sistor,  capacitor  and  inductor,  there  must  exist  the  fourth  basic  two-terminal  element 
that  uniquely  defines  the  relationship  between  the  magnetic  flux  (<p)  and  the  electric 
charge  ( q )  passing  through  the  device  [1],  or 


d(p  =  M  ■  dq. 


(1) 


Considering  that  magnetic  flux  and  electric  charge  are  the  integrals  of  voltage  (V) 
and  current  (I)  over  time,  respectively,  the  definition  of  the  memristor  can  be  gener¬ 
alized  as: 


(2) 


Here,  (0  is  a  state  variable;  M(co,I)  represents  the  instantaneous  memristance, 
which  varies  over  time.  For  a  “pure”  memristor,  neither  M(co,I)  nor  /(ft),/)  is  an 
explicit  function  of  I  [5]. 


2.2  Basics  ofTi02  Thin-Film  Memristor 

In  2008,  HP  Lab  demonstrated  the  first  intentional  memristive  device  by  using  a 
PtAl  iOo/Pt  thin-film  structure  [2],  The  conceptual  view  is  illustrated  in  Fig.  1(a): 
two  metal  wires  on  Pt  are  used  as  the  top  and  bottom  electrodes,  and  a  thick  ti¬ 
tanium  dioxide  film  is  sandwiched  in  between.  The  stoichiometric  TiC>2  with  an 
exact  2:1  ratio  of  oxygen  to  titanium  has  a  natural  state  as  an  insulator.  However,  if 
the  titanium  dioxide  is  lacking  a  small  amount  of  oxygen,  its  conductivity  becomes 
relatively  high  like  a  semiconductor.  We  call  it  oxygen-deficient  titanium  dioxide 
(Ti02-jr)  [9].  The  memristive  function  can  be  achieved  by  moving  the  doping  front: 


Doping 


front 


(a) 


(b) 


Fig.  1  TiCF  thin-film  memristor.  (a)  structure,  and  (b)  equivalent  circuit. 
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A  positive  voltage  applied  on  the  top  electrode  can  drive  the  oxygen  vacancies  into 
the  pure  TiOi  part  and  therefore  lower  the  resistance  continuously.  On  the  other 
hand,  a  negative  voltage  applied  on  the  top  electrode  can  push  the  dopants  back  to 
the  TiCH-*  part  and  hence  increase  the  overall  resistance.  For  a  TiCH-based  mem¬ 
ristor,  Ri  (Rh)  is  used  to  denote  the  lowest  (highest)  resistance  of  the  structure. 

Fig.  1(b)  illustrates  a  coupled  variable  resistor  model  for  a  TiCF-based  memristor, 
which  is  equivalent  to  two  series-connected  resistors.  The  overall  resistance  can  be 
expressed  as 

M(a)  =RLa+RH  •  (1  -a).  (3) 

Here  a  (0  <  a  <  1)  is  the  relative  doping  front  position,  which  is  the  ratio  of  doping 
front  position  over  the  total  thickness  of  TiOi  thin-film. 

The  velocity  of  doping  front  movement  v(t),  which  is  driven  by  the  voltage  ap¬ 
plied  across  the  memristor  V{t)  can  be  expressed  as 

v(t)  _da  Rl  V(t ) 
h  dt  Mv '  h 2  '  M{a)  ' 

where,  jlv  is  the  equivalent  mobility  of  dopants,  h  is  the  total  thickness  of  the  TiC>2 
thin-film;  and  M(a)  is  the  total  memristance  when  the  relative  doping  front  position 
is  a. 

Filamentary  conduction  has  been  observed  in  nano-scale  semiconductors,  such 
as  TiC>2.  It  shows  that  the  current  travels  through  some  high  conducting  filaments 
rather  than  passes  the  device  evenly  [17] [18].  However,  there  is  no  device  model 
based  on  filamentary  conduction  mechanism  yet.  Considering  that  the  main  focus 
of  this  work  is  the  process  variation  analysis  method  of  the  memristor,  which  can  be 
separated  from  the  explicit  physical  model  of  memristor,  the  popular  bulk  model  of 
TiC>2  is  applied.  We  will  extend  the  research  by  integrating  the  device  model  based 
on  filamentary  conduction  in  our  future  work. 

Recent  experiments  showed  that  pv  is  not  a  constant  but  grows  exponentially 
when  the  bias  voltage  goes  beyond  certain  threshold  voltage  [19].  Nevertheless,  the 
structure  of  TiCF  memristor  model,  i.e.,  Eq.  (3),  still  remains  valid. 


2.3  Basics  of  Spintronic  Memristor 

Among  all  the  spintronic  memristive  devices,  the  one  based  on  magnetic  tun¬ 
neling  junction  (MTJ)  could  be  the  most  promising  one  because  of  its  simple 
structure  [3][15],  The  basic  structure  of  magnetic  memristor  could  be  either  gi¬ 
ant  magneto-resistance  (GMR)  or  tunneling  magneto-resistance  (TMR)  MTJs.  We 
choose  TMR-based  structure  shown  in  Fig.  2(a)  as  the  objective  of  this  work  be¬ 
cause  it  has  a  bigger  difference  between  the  upper  and  the  lower  bounds  of  total 
memristance  (resistance). 

There  have  been  many  research  activities  investigated  on  the  spintronic  mem¬ 
ristor  or  the  similar  device  structure,  such  as  the  racetrack  structure  proposed  by 
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Fig.  2  TMR-based  spintronic  memristor.  (a)  structure,  and  (b)  equivalent  circuit. 


IBM  [20],  Very  recently,  NEC  Lab  reported  the  free  layer  switching  through  the 
domain  wall  movement  [21],  which  indeed  is  a  spintronic  memristor. 

An  MTJ  is  composed  of  two  ferromagnetic  layers  and  an  oxide  barrier  layer, 
e.g.  MgO.  The  bottom  ferromagnetic  layer  is  called  reference  layer,  of  which  the 
magnetization  direction  is  fixed  by  coupling  to  a  pinned  magnetic  layer.  The  top 
ferromagnetic  layer  called  free  layer  is  divided  into  two  magnetic  domains  by  a 
domain-wall:  the  magnetization  direction  of  one  domain  is  parallel  to  the  reference 
layer’s,  while  the  magnetization  direction  of  the  other  domain  is  anti-parallel  to  the 
reference  layer’s. 

The  movement  of  the  domain  wall  is  driven  by  the  spin-polarized  current,  which 
passes  through  the  two  ferromagnetic  layers.  For  example,  applying  a  positive  volt¬ 
age  on  free  layer  can  impel  the  domain  wall  to  increase  the  length  of  the  magnetic 
domain  with  a  magnetization  direction  parallel  to  the  reference  layer’s  and  hence 
reduce  the  MTJ  resistance.  On  the  other  hand,  applying  a  positive  voltage  on  ref¬ 
erence  layer  will  reduce  the  length  of  the  magnetic  domain  with  a  magnetization 
direction  parallel  to  the  reference  layer’s.  Therefore,  the  MTJ  resistance  increases. 
If  the  width  of  the  domain  with  the  magnetization  direction  anti-parallel  (parallel) 
to  the  reference  layer’s  is  compressed  to  close  to  zero,  the  memristor  has  the  lowest 
(highest)  resistance,  denoted  as  Ri  (Rh)- 

As  shown  in  Fig.  2(b),  the  overall  resistance  of  a  TMR-base  spintronic  mem¬ 
ristor  can  be  modeled  as  two  parallel  connected  resistors  with  resistances  Rl/ol 
and  Rh/(\—  a),  respectively  [15].  This  structure  has  also  been  experimentally 
proved  [22],  Here  a  (0  <  a  <  1)  represents  the  relative  domain  wall  position  as 
the  ratio  of  the  domain  wall  position  (x)  over  the  total  length  of  the  free  layer  (L). 
The  overall  memristance  can  be  expressed  as 


M(a) 


Rl-Rh 

RHa+RL(l-a)' 


(5) 


How  fast  the  domain-wall  can  move  is  mainly  determined  by  the  strength  of  spin- 
polarized  current.  More  precisely,  the  domain-wall  velocity  v(f)  is  proportional  to 
the  current  density  J  [23].  We  have 
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m 


yjt) 

M(a) -L-z 


(6) 


and 


v(0 


da(t) 

dt 


n 

L 


J,J>Jcr 

0,J<Jcr- 


(7) 


Here  rv  is  the  domain  wall  velocity  coefficient,  which  is  related  to  device  structure 
and  material  property.  L  and  z  are  the  total  length  and  width  of  the  spintronic  mem¬ 
ristor,  respectively.  The  domain  wall  movement  in  the  spintronic  memristor  happens 
only  when  the  applied  current  density  (J)  is  above  the  critical  current  density  (Jcr) 
[23]  [24]  [25]  [26]  [27], 


3  Mathematical  Analysis 

The  actual  length  (L)  and  width  (z)  of  a  memristor  is  affected  by  LER.  The  variation 
of  thickness  (h)  of  a  thin  film  structure  is  usually  described  by  TF.  As  a  matter  of 
convenience,  we  define  that,  the  impact  of  process  variations  on  any  given  variable 

(o' 

can  be  expressed  as  a  factor  6  =  — ,  where  ft)  is  its  ideal  value,  and  ft)  is  the  actual 

ft) 

value  under  process  variations. 

The  ideal  geometry  dimensions  of  the  TiC>2  thin-film  memristor  and  spintronic 
memristor  used  in  this  work  are  summarized  in  Table  1 . 


3.1  TiO 2  Thin-Film  Memristor 

In  TiCE  thin-film  memristors,  the  current  passes  through  the  device  along  the  thick¬ 
ness  (h)  direction.  Ideally  the  doping  front  has  an  area  S  =  L  -z.  To  simulate  the  im¬ 
pact  of  LER  on  the  electrical  properties,  the  memristor  device  is  divided  into  many 
small  filaments  between  the  two  electrodes.  Each  filament  i  has  a  cross-section  area 
ds  and  a  thickness  h.  Fig.  3  demonstrates  a  non-ideal  3D  structure  of  a  TiCH  memris¬ 
tor  (i.e.,  with  geometry  variations  in  consideration),  which  is  partitioned  into  many 
filaments  in  statistical  analysis. 

As  shown  in  Fig.  3,  ideally,  the  cross-section  area  of  a  filament  is  ds/S  of  the 
entire  device  area  and  its  thickness  is  h.  Thus,  for  filament  i,  the  ideal  upper  bound 
and  lower  bound  of  the  memristance  can  be  expressed  as 


Table  1  The  device  dimensions  of  memristors. 


|Length(L)  Width(z)  Thickness(h) 

Thin-film 

50  nm 

50  nm 

10  nm 

Spintronic 

200  nm 

10  nm 

7  nm 
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Here,  0,  s  represents  the  variation  ratio  on  the  cross-section  area  ds ,  which  is 
caused  by  2-D  LER.  Similarly,  0,/,  is  the  variation  ratio  on  thickness  h  due  to  TF. 
The  resistance  of  a  filament  is  determined  by  its  section  area  and  thickness,  i.e., 
R  =  p  ■  where  p  is  the  resistance  density.  Therefore,  the  actual  upper  and  the 
lower  bound  under  the  process  variations  can  be  expressed  as 


i  0;  h  i  0/  h 

R'uh  =  Rifl  ■  7^ ,  and  R'h L  =  RUL  ■  . 

“ i.s  “ i,s 


(9) 


If  a  filament  is  small  enough,  we  can  assume  it  has  a  flat  doping  front.  Then,  the 
actual  doping  front  velocity  in  filament  i  considering  process  variations  can  be  cal¬ 
culated  by  replacing  the  ideal  values  with  actual  values  in  Eq.(4).  We  have 


v/(f)  =  pv 


R'i,L  V{t) 


h'2  M^alY 


(10) 


Here  It  and  M\  are  the  actual  thickness  and  memristance  of  filament ;.  Then,  we  can 
get  a  set  of  related  equations  for  filament  i,  including  the  doping  front  position 


Jo 

the  corresponding  memristance 

M,M)  =  cc'rR'iL  +  (l-a'i)-R'iH, 
and  the  current  through  the  filament  i 

V(t) 


4(0  = 


Mi(a'i)  ’ 


(ii) 


(12) 


03) 


By  combining  Eq.  (10)  -  (13),  the  doping  front  position  in  every  filament  i  under 
process  variations  a\(t)  can  be  obtained  by  solving  the  differential  equation 


da'j(t) 

dt 


R' 


=  Hv 


i.L 


V(t) 


h'2  «;(o-^x+(i-«;(0)-^. 


(14) 


i,H 


Eq.  (14)  indicates  that  the  behavior  of  the  doping  front  movement  is  dependent 
on  the  specific  electrical  excitations,  e.g.,  V (t). 

For  instance,  applying  a  sinusoidal  voltage  source  to  the  TiC>2  thin-film  memris- 
tor  such  as 

V(0=Vm-sin(2*/-0,  (15) 

the  corresponding  doping  front  position  of  filament  i  can  be  expressed  as: 
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Fig.  3  An  example  of  3D  TiOi  memristor  structure,  which  is  partitioned  into  many  filaments  in 
statistical  analysis. 


Rifl  ~  JRlH-A-B(t)-el+2c-A-9e- 
a'(t)  = - * - - - - - -■  (16) 

Where,  A  =  R,  #  —  Ri± ,  B{t)  =  fiv  ■  Rj  i  ■  Vm  •  cos(27t/  •  t),  and  C  is  an  initial  state 
constant. 

The  term  B{t)  accounts  for  the  effect  of  electrical  excitation  on  doping  front 
position.  The  terms  6I  S  and  0,  /,  represent  the  effect  of  both  LER  and  TF  on  mem- 
ristive  behavior.  Moreover,  the  impact  of  the  geometry  variations  on  the  electrical 
properties  of  memristors  could  be  affected  by  the  electrical  excitations.  For  exam¬ 
ple,  we  can  set  «(0)  =0  to  represent  the  case  that  the  TiCT  memristor  starts  from 
M{ 0)  =  Rh-  In  such  a  condition,  C  becomes  0,  and  hence,  the  doping  front  position 
a-(t)  can  be  calculated  as: 


Rifl  — 


«/(0  = 


rIh 


(17) 


which  is  affected  only  by  TF  and  electrical  excitations.  FER  will  not  disturb  (l[ (t) 
if  the  TKD2  thin-film  memristor  has  an  initial  state  c<(0)  =  0. 

The  overall  memristance  of  the  memristor  can  be  calculated  as  the  total  resistance 
of  all  n  filaments  connected  in  parallel.  Again,  i  denotes  the  ith  filament.  When  n 
goes  to  oo,  we  can  have 


and 


R'h  = 


H  r°°  i  /r,/ 


7 -.=Rh 


j~i/R'iH-di  n  jodLh/eLS-di' 


R'l  = 


t.=Rl 


fo  Jo  @i,h/Qi,s'di 


(18) 


(19) 
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The  overall  current  through  the  memristor  is  the  sum  of  the  current  through  each 
filament: 

l'(t)=  [  i':  (t)  ■  di.  (20) 

Jo 

The  instantaneous  memristance  of  the  overall  memristor  can  be  defined  as 


M'(t)  = 


i 

fc 


(21) 


Since  the  doping  front  position  movement  in  each  filament  will  not  be  the  same 
because  h'-  varies  due  to  TF  (and/or  the  roughness  of  the  electrode  contact),  we 
define  the  average  doping  front  position  of  the  whole  memristor  as: 


«'(0 


R'h-R'l  ' 


(22) 


3.2  Spintronic  Memristor 


Since  the  length  of  a  spintronic  memristor  is  usually  much  longer  than  the  other 
two  dimensions,  the  impact  of  the  variance  in  length  on  the  spintronic  memristor’s 
electrical  properties  can  be  ignored.  In  our  analysis,  the  device  can  be  chopped  into 
infinite  segments  along  the  length  direction  as  shown  in  Fig.  4.  For  a  segment  i,  the 
upper  and  lower  bounds  of  memristance  are: 


i  ft  /,  ,  0/  /) 

R'l.H=Rl.H-^:OOd  R'u  =RlL.-^. 

Ui.Z,  Ui,z 


(23) 


Here  we  assume  the  ideal  memristance  changes  linearly  within  the  domain  wall, 
or  Mj  changes  linearly  from  //  ,  /  to  R^.h  when  j  <  i  <  k.  Here  j  and  k  are  the 


3-D  model  for  TMR-based  spintronic  memristor 


Fig.  4  An  example  of  3D  TMR-based  spintronic  memristor  structure,  which  is  partitioned  into 
many  filaments  in  statistical  analysis. 


10 


Springer  Series  in  Cognitive  and  Neural  Stystems 
Volume  4,  2012,  pp  107-131 


Statistical  memristor  model  and  its  applications  in  neuromorphic  computing 


11 


two  segments  at  the  two  boundaries  of  domain  wall  and  connected  to  the  magnetic 
domains  with  either  the  low  or  the  high  resistance  states.  The  memristance  of  each 
segment  is 


M'  = 


R' 


L’i  <  a 


R'i.H  i  i  >  a' 


(24) 


So  for  overall  resistance  R'H  and  R'L,  we  have 


R'h  = 


lol/RU-di 


-=Rh- 


Jo  9r,z/0i,h  ■  di  ’ 


(25) 


and 

D,  _  1  _  D  1 
Rl  ~  Jo  1/R'i, l  ■  di  ~  Rl '  Jo  0,„  •  di ' 

Then  the  memristance  of  the  whole  device  is 


M'(a') 


I o  R'ul 


di 


rl  1 

a'Rjt 

1 


-di 


r “  j_ 
lo  Ri.L'  o, 


di 


ill 


r^di 

I  a'  RUh  &i.h 


(26) 


(27) 


Here  the  width  of  each  segments  zi  varies  segment  by  segment  due  to  the  LER 
effect.  The  statistical  behavior  of  spintronic  memristors  can  still  be  evaluated  by 
Monte-Carlo  simulation  in  Section  5. 

We  assume  the  current  density  applied  on  the  domain  wall  J'(t)  is  the  one  of  the 
segments  i  where  the  domain  wall  located  in  the  middle: 


J'(t)=j'i  = 


m 

M'(a')  L-z'i 


(28) 


Then  the  domain  wall  velocity  under  process  variations  can  be  calculated  as: 


,  ,  da'{t)  rv  . 

=  =  =  y4//«, 


J'eff  ~ 


dt 

/./  >  Jc, 

0  J  <Ja 


(29) 


4  3D  Memristor  Structure  Modeling 

Analytic  modeling  is  a  fast  way  to  estimation  the  impact  of  process  variations  on 
memristors.  However,  we  noticed  that  in  modeling  some  variations  analytically,  e.g. 
simulating  the  LER,  may  be  beyond  the  capability  of  analytic  model  [12].  The  data 
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on  silicon  variations,  however,  is  usually  very  hard  to  obtain  simply  due  to  intel¬ 
lectual  property  protection.  To  improve  the  accuracy  of  our  evaluations,  we  create  a 
simulation  flow  to  generate  3-D  memristor  samples  with  the  geometry  variations 
including  LER  and  thickness  fluctuation.  The  correlation  between  the  generated 
samples  and  the  real  silicon  data  are  guaranteed  by  the  sanity  check  of  the  LER 
characterization  parameters.  The  flow  is  shown  in  Fig.  5. 

Many  factors  affecting  the  quality  of  the  line  edges  show  different  random  ef¬ 
fects.  Usually  statistical  parameters  such  as  the  auto-correlation  function  (ACF)  and 
power  spectral  density  (PSD)  are  used  to  describe  the  property  of  the  line  edges. 

ACF  is  a  basic  statistical  function  of  the  wavelength  of  the  line  profile,  represent¬ 
ing  the  correlation  of  point  fluctuations  on  the  line  edge  at  different  position.  PSD 
describes  the  waveform  in  the  frequency  domain,  reflecting  the  ratio  of  signals  with 
different  frequencies  to  the  whole  signal. 

Considering  that  LER  issues  are  related  to  fabrication  processes,  we  mainly  tar¬ 
get  the  nano-scale  pattern  fabricated  by  electron  beam  lithography  (EBL).  The  mea¬ 
surements  show  that  under  such  a  condition,  the  line  edge  profile  has  two  important 
properties:  (1)  the  line  edge  profile  in  ACF  figure  demonstrates  regular  oscillations, 
which  are  caused  by  periodic  composition  in  the  EBL  fabrication  system;  and  (2)  the 
line  edge  roughness  mainly  concentrates  in  a  low  frequency  zone,  which  is  reflected 
by  PSD  figure  [12]. 

To  generate  line  edge  samples  close  to  the  real  cases,  we  can  equally  divide 
the  entire  line  edge  into  many  segments,  say,  n  segments.  Without  losing  the  LER 
properties  in  EBL  process,  we  modified  the  random  LER  modeling  proposed  in  [28] 
to  a  simpler  form  with  less  parameters.  The  LER  of  the  ith  segment  can  be  modeled 
by 

LER/  =  Llf  ’  sin (fmax  '  %i)  “1“  Lhf  ’  Pi-  (30) 

The  first  term  on  the  right  side  of  Eq.  (30)  represents  the  regular  disturbance  at 
the  low  frequency  range,  which  is  modeled  as  a  sinusoid  function  with  amplitude 
Llf-  fmax  the  mean  of  the  low  frequency  range  derived  from  PSD  analysis.  Without 


Fig.  5  The  flow  of  3D  memristor  structure  generation  including  geometry  variations. 


12 


Springer  Series  in  Cognitive  and  Neural  Stystems 
Volume  4,  2012,  pp  107-131 


Statistical  memristor  model  and  its  applications  in  neuromorphic  computing  13 

Table  2  The  parameters/constraints  in  LER  characterization. 


Parameters 

Constraints 

Llf 

0.8  nm 

aLER 

2.5nm  - 

^  3.5nm 

fmax 

1.8  MHz 

\Olwr  4.0nm  - 

^  5.0nm 

Lhf 

0.4  nm 

Sk 

O.lnm- 

^  0.2nm 

/ 

/ 

Ku 

2.5nm  - 

^  3.5nm 

loss  of  generality,  a  uniform  distribution  x(-  €  £/(—  1 , 1 )  is  used  to  represent  an  equal 
distribution  of  all  frequency  components  in  the  low  frequency  range.  The  high  fre¬ 
quency  disturbances  are  also  taken  into  account  by  the  second  term  on  the  right  side 
of  Eq.  (30)  as  a  Gaussian  white  noise  with  amplitude  Lhf  ■  Here  /?,  follows  the  nor¬ 
mal  distribution  N(0, 1)  [12],  The  actual  values  of  L/  /.  ,  Lhf  and  fmax  are  determined 
by  ACF  and  PSD. 

To  ensure  the  correlation  between  the  generated  line  edge  samples  with  the  mea¬ 
surement  results,  we  introduce  four  constraints  to  conduct  a  sanity  check  of  the 
generated  samples: 

•  07/./, >:  the  root  mean  square  (RMS)  of  LER; 

•  (7/  u'A’ :  the  RMS  of  line  width  roughness  (LWR); 

•  Sk:  skewness,  used  to  specify  the  symmetry  of  the  amplitude  of  the  line  edge; 

and 

•  Ku:  kurtosis,  used  to  describe  the  steepness  of  the  amplitude  distribution  curve. 

The  above  four  parameters  are  widely  used  in  LER  characterization  and  can  be 
obtained  from  measurement  results  directly  [12].  Only  the  line  edge  samples  that 
satisfy  the  constraints  will  be  taken  as  valid  device  samples.  Table  2  summarizes 
the  parameters  used  in  our  algorithm,  which  are  correlated  with  the  characterization 
method  and  experimental  results  in  [12].  And  Fig.  6  shows  the  LER  characteristic 
parameters  distribution  among  1000  Monte-Carlo  simulations. 

Even  the  main  function  has  captured  the  major  features  of  LER,  it  is  not  enough 
to  mimic  all  the  LER  characteristics.  The  difference  between  real  LER  distribution 
and  our  modeling  function  results  in  the  fact  that  some  generated  samples  are  not 
qualified  compared  to  the  characteristic  parameters,  or  the  constraints  of  the  real 
LER  profile.  Thus,  sanity  check  which  screens  out  the  unsuccessful  results  is  nec¬ 
essary.  Only  those  samples  in  red  rectangles  shown  in  Fig.  6  satisfy  the  constraints 
and  will  be  used  for  the  device  electrical  property  analysis.  The  criteria  of  the  sanity 
check  are  defined  based  on  the  measurement  results  of  real  LER  data. 

The  thickness  fluctuation  is  caused  by  the  random  uncertainties  in  sputter  depo¬ 
sition  or  atomic  layer  deposition.  It  has  a  relatively  smaller  impact  than  the  LER 
and  can  be  modeled  as  a  Gaussian  distribution.  Since  the  memristors  in  this  work 
have  relatively  bigger  dimensions  in  the  horizontal  plane  than  the  thickness  direc¬ 
tion  (shown  in  Table  1),  we  also  considered  roughness  of  electrode  contact  in  our 
simulation:  The  means  of  the  thickness  of  each  memristor  is  generated  by  assuming 
it  follows  the  Gaussian  distribution.  Each  memristor  is  then  divided  into  many  fila¬ 
ments  between  the  two  electrodes.  The  roughness  of  electrode  contacts  is  modeled 
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Fig.  6  LER  characteristic  parameters  distribution  among  1000  Monte-Carlo  simulations.  Con¬ 
straints  are  shown  in  red  rectangles. 


based  on  the  variations  of  the  thickness  of  each  filament.  Here,  we  assume  that  both 
thickness  fluctuations  and  electrode  contact  roughness  follow  Gaussian  distributions 
with  a  deviation  a  =  2%  of  thin  film  thickness. 

Fig.  3  is  an  example  of  3D  structure  of  a  TiOi  thin-film  memristor  generated  by 
the  proposed  flow.  It  illustrates  the  effects  of  all  the  geometry  variations  on  a  T1O2 
memristor  device  structure.  According  to  Section  3,  a  2-D  partition  is  required  for 
the  statistical  analysis.  In  the  given  example,  we  partition  the  device  into  25  small 
filaments  with  the  ideal  dimensions  of  L  =  10 nm,  z.  =  10/un,  and  h  =  10///;/.  Each 
filament  can  be  regarded  as  a  small  memristor,  which  is  affected  by  either  only  TF 
or  both  LER  and  TF.  The  overall  performance  of  device  can  be  approximated  by 
paralleled  connecting  all  the  filaments. 

Similarly,  Fig.  4  is  an  example  of  3D  structure  of  a  TMR-based  spintronic  mem¬ 
ristor.  Since  the  length  of  a  spintronic  memristor  is  much  longer  than  its  width  and 
height,  only  1-D  partition  along  the  length  direction  is  required.  In  this  case,  the 
device  is  divided  into  200  filaments.  Ideally,  each  filament  has  L  =  1  nm,  z  =  10 nm, 
and  h  =  Inm.  Each  filament  i  is  either  in  the  low  resistance  state  R't  L  or  the  high 
resistance  state  R't  H,  with  considering  the  effects  of  both  LER  and  TF.  The  overall 
performance  of  device  can  be  approximated  by  paralleled  connecting  all  the  fila¬ 
ments. 


5  Experimental  Results 
5.1  Simulation  Setup 

To  evaluate  the  impact  of  process  variations  on  the  electrical  properties  of  mem- 
ristors,  we  conducted  Monte-Carlo  simulations  with  10,000  qualified  3-D  device 
samples  generated  by  our  proposed  flow.  A  sinusoidal  voltage  source  shown  in  Eq. 
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Table  3  Memristor  Devices  and  electrical  parameters 

TiCF  thin-film  memristor  [2] 

Rl(C2)  RH(n)  Mm-.s-1  -V-1)  ~j  V,„  (V)  /  (Hz) 

100  16000  IQ" 14 _ / _ 1  0.5 

Spintronic  memristor  [15] 

Rl(£2)  Rh(£2)  r].(nmJ-  C~‘)  Jcr  (A  /  nm2)  Vm  (V)  /  (Hz) 

2500  7500  2.01  x  10~14  2.00  x  10~8  2  10M 


(15)  is  applied  as  the  external  excitation.  The  initial  state  of  the  memristor  is  set  as 
M(a  =  0)  =  Rh-  The  device  and  electrical  parameters  used  in  our  simulations  are 
summarized  in  Table  3.  Both  separate  and  combined  effects  of  geometry  variations 
on  various  properties  of  memristors  are  analyzed,  including: 

•  the  distribution  of  Rh  and  R/  ; 

•  the  change  of  memristance  M(t)  and  M(a); 

•  the  velocity  of  wall  movement  v(a); 

•  the  current  through  memristor  /(f);  and 

•  the  I-V  characteristics. 


5.2  T1O2  Thin-Film  Memristor 

The  ±3(7  (minimal/maximal)  values  of  the  device/electrical  parameters  as  the  per¬ 
centage  of  the  corresponding  ideal  values  are  summarized  in  Table  4.  For  those 
parameters  that  vary  over  time,  we  consider  the  variation  at  each  time  step  of  all  the 


Fig.  7  Simulation  results  for  TiOi  thin-film  memristors.  The  blue  curves  are  from  100  Monte- 
Carlo  simulations,  and  red  lines  are  the  ideal  condition.  From  top  left  to  right  bottom,  the  figures 
are  Ru  vs.  Rl\  M(t )  vs.  f;  v  vs.  a;  a  vs.  f;  I  vs.  f;  and  1  —  V  characteristics. 
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Table  4  3cr  min./max.  of  TiCk  memristor  parameters 


Sinusoidal 

Voltage 

LER  only 

— 3<r(%)  +3<t(%) 

TF  only 

-3ct(%)  +3<t(%) 

overall 

—  3<r(%)  +3<J(%) 

Rh&Rl 

-5.4 

4.1 

-5.5 

4.8 

-6.4 

7.3 

M(a) 

-5.4 

4.1 

-37.1 

20.8 

-36.5 

24.1 

«(0 

0.0 

0.0 

-13.3 

27.5 

-14.7 

27.4 

v(«) 

0.0 

0.0 

-9.3 

15.6 

-10.4 

16.9 

«'(«) 

-4.7 

5.7 

-9.3 

15.7 

-10.7 

17.2 

Power 

-4.7 

5.7 

OO 

OO 

14.1 

-10.1 

15.6 

Square  wave 
Voltage 

LER  only 

— 3c(%)  +3<r(%) 

TF  only 

-3a(%)  +3<t(%) 

overall 

—  3<r(%)  +3c(%) 

Rh&Rl 

-5.3 

3.7 

-6.2 

5.2 

-6.6 

6.9 

M(a) 

-5.3 

3.7 

-17.8 

13.2 

-15.4 

14.4 

a(t ) 

0.0 

0.0 

-12.1 

16.6 

-13.0 

15.6 

v(a) 

0.0 

0.0 

-11.6 

17.7 

-12.5 

16.7 

i(a) 

-4.0 

5.2 

-11.7 

17.7 

-12.6 

17.6 

Power 

-4.0 

5.2 

-7.7 

9.8 

-8.5 

10.1 

devices.  The  simulation  results  considering  only  either  LER  or  TF  are  also  listed.  To 
visually  demonstrate  the  overall  impact  of  process  variations  on  the  memristive  be¬ 
havior  ofTiCH  memristors,  the  dynamic  responses  of  100  Monte  Carlo  simulations 
are  shown  in  Fig.  7. 

Table  4  shows  that  the  static  behavior  parameters  of  memristors,  i.e.,  R/i  and 
R[  ,  are  affected  in  a  similar  way  by  both  LER  and  thickness  fluctuations.  This  is 
consistent  to  our  analytical  results  in  Eq.  (18)  and  (19),  which  show  that  9S  and  6/, 
have  the  similar  effects  on  the  variation  of  R'H  and  R'L. 

However,  thickness  fluctuation  shows  a  much  more  significant  impact  on  the 
memristive  behaviors  such  as  v(f),  a(t)  and  M(a ),  than  LER  does.  It  is  because 
the  doping  front  movement  is  along  the  thickness  direction:  v(t)  is  inversely  pro¬ 
portional  to  the  square  of  the  thickness,  and  a(t)  is  the  integral  of  v(t  )  over  time  as 
shown  in  Eq.  (10)  and  (11).  For  the  same  reason,  thickness  fluctuations  significantly 
affect  the  instantaneous  memristance  M ( a )  as  well. 

Because  the  thickness  of  the  TiC>2  memristor  is  relative  small  compared  to  other 
dimensions,  we  assume  the  doping  front  cross-section  area  is  a  constant  along  the 
thickness  direction  in  our  simulation.  The  impact  of  LER  on  a(t)  or  v(t),  which  is 
relatively  small  compared  to  that  of  the  thickness  fluctuations,  is  ignored  in  Table  4. 

An  interesting  observation  in  Fig.  7  is  that  as  the  doping  front  a  moves  toward 
1,  the  velocity  v  regularly  grows  larger  and  reaches  its  peak  at  the  half  period  of  the 
sinusoidal  excitation,  i.e.  r=ls.  This  can  be  explained  by  Eq.  (12):  the  memristance 
is  getting  smaller  as  a  moves  toward  1.  With  the  same  input  amplitude,  a  smaller 
resistance  will  result  in  a  bigger  current  and  therefore  a  bigger  variation  on  v(t). 
Similarly,  memristance  M(a )  reaches  its  peak  variance  when  a  is  close  to  1. 

We  also  conduct  1 0,000  x  Monte  Carlo  simulations  on  the  same  samples  by  ap¬ 
plying  a  square  wave  voltage  excitation.  The  amplitude  of  the  voltage  excitation  is 
±0.5V.  The  simulation  results  are  also  shown  in  Table  4.  The  results  of  the  static 
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behavior  parameters,  i.e.,  R/i  and  R[,  are  exactly  the  same  as  those  with  sinusoidal 
voltage  inputs  because  they  are  independent  of  the  external  excitations.  The  results 
of  the  memristive  behavior  parameters  such  as  v(t),  u(t)  and  M(a)  show  similar 
trends  as  those  with  the  sinusoidal  voltage  inputs.  Based  on  Eq.  (16),  cc(t)’ s  vari¬ 
ance  is  sensitive  to  the  type  and  amplitude  of  electrical  excitation,  because  B(t) 
greatly  affects  the  weight  of  the  thickness  fluctuation  parameter.  That  is  why  the 
thickness  fluctuation  has  a  significantly  impact  on  the  electrical  properties  of  mem- 
ristors  under  sinusoidal  and  square  voltage  excitations. 


5.3  Spintronic  Memristor 

The  ±3cr  values  of  the  device/electrical  parameters  based  on  10,000  Monte-Carlo 
simulations  are  summarized  in  Table  5.  The  visual  demonstration  of  100  Monte- 
Carlo  simulations  with  a  sinusoidal  voltage  excitation  is  shown  in  Fig.  8. 

For  the  spintronic  memristor,  the  impact  of  LER  on  the  electrical  properties  of 
memristors  is  more  than  that  of  thickness  fluctuation.  This  is  because  the  direction 
of  the  domain  wall  movement  is  perpendicular  to  the  direction  of  spin-polarized 
current.  The  impact  of  thickness  fluctuations  on  very  small  segments  cancel  each 
other  during  the  integral  along  the  direction  of  the  domain  wall  movement. 

“LER  only”  simulation  results  show  that  the  ±3(7  corner  of  LER  has  more  im¬ 
pact  on  the  electrical  properties  than  that  of  —3(7  corner.  This  is  because  the  line 
width  variation  is  the  dominant  factor  on  the  variation  of  electrical  properties  of 
spintronic  memristors,  and  the  line  edge  profiles  used  in  our  LER  parameters  have 


RH(Om)  t(ns)  a 


t  vs  Position  100  times 


t(ns) 


t(ns) 


Voltage(V) 


Fig.  8  Simulation  results  for  spintronic  memristors.  The  blue  curves  are  from  100  Monte-Carlo 
simulations,  and  red  lines  are  the  ideal  condition.  From  top  left  to  right  bottom,  the  figures  are  Rh 
vs.  Rl\  M(t)  vs.  t\  v  vs  .a;  a  vs.  t;  /  vs.  ?;  and  I  —  V  characteristics. 
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Table  5  3(7  min./max.  of  spintronic  memristor  parameters 


Sinusoidal 

Voltage 

LER  only 

— 3c(%)  +3<t(%) 

TF  only 

-3ct(%)  +3<t(%) 

overall 

-3<t(%)  +3ff(%) 

Rh&Rl 

-15.3 

22.9 

-6.1 

5.8 

-16.4 

20.9 

M(a) 

-15.1 

23.3 

-11.0 

11.0 

-16.3 

21.1 

«(0 

-9.7 

8.1 

-8.4 

9.5 

-11.8 

8.1 

v(«) 

-10.7 

22.1 

-9.1 

9.9 

-21.5 

22.5 

;(«) 

-18.5 

18.5 

-8.9 

10.1 

-17.7 

17.8 

Power 

-18.4 

18.6 

-8.3 

9.4 

-17.8 

17.8 

Square  wave 
Voltage 

LER  only 

— 3c(%)  +3(J(%) 

TF  only 

—3o(%)  +3<t(%) 

overall 

—  3c(%)  +3c(%) 

Rh&Rl 

-15.8 

22.0 

-5.3 

5.7 

-15.9 

24.2 

M(a) 

-15.6 

21.8 

-8.5 

9.7 

-17.0 

25.5 

a(t ) 

-13.1 

13.8 

-7.5 

7.7 

-17.2 

16.2 

v(a) 

-16.5 

20.7 

-10.0 

8.3 

-20.1 

25.2 

i(a) 

-19.5 

17.1 

-9.0 

9.3 

-22.1 

20.5 

Power 

-19.4 

17.1 

-7.6 

7.7 

-20.9 

19.6 

a  right-biased  feature  [12].  Since  normal  distribution  is  assumed  for  the  variations 
of  thickness,  (7/,  has  approximately  symmetric  impact  on  ±3(7  corners. 

The  impact  of  LER  on  the  memristive  parameters  v(t),  oc(t)  and  M(a )  is  also 
larger  than  thickness  variation.  Again,  the  impact  of  thickness  fluctuations  on  very 
small  segments  cancel  each  other  during  the  integral  along  the  direction  of  the  do¬ 
main  wall  movement. 

Similarly,  we  also  conduct  Monte  Carlo  simulations  by  applying  a  square  wave 
voltage  excitation.  The  amplitude  of  the  voltage  excitation  is  ±1V.  The  similar 
trends  as  that  of  sinusoidal  excitations  are  observed. 


6  Memristor-based  Synapse  Design 

6.1  The  Principle  of  Memristor-based  Synapse 

Rather  than  using  memristor  crossbar  array  in  neuromorphic  reconfigurable  archi¬ 
tecture,  we  propose  a  memristor-based  synapse  design  to  mimic  the  biological  struc¬ 
ture.  Fig.  9(a)  depicts  the  conceptual  scheme,  which  simply  consists  of  a  NMOS 
transistor  (Q)  and  a  memristor.  When  the  input  Vm  is  low,  Q  is  turned  off  and  the 
output  Vout  is  connected  to  ground  through  the  memristor.  On  the  contrary,  when 
Vin  is  high  and  turns  on  Q ,  memristance  M  and  the  equivalent  resistance  of  Q  ( Rq ) 
together  determine  Vout  '■ 

V0ut=f(Vin-M).  (31) 
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(a)  (b) 

Fig.  9  (a)  Proposed  synapse  design,  (b)  Synapse  output  vs.  memristance. 


Here,  Vout  is  weighted  by  the  memristance,  which  behaves  like  a  synapse.  Fig.  9(b) 
shows  the  simulated  Vout  when  sweeping  the  memristance  from  1 KQ  to  16KQ. 
Here,  CMOS  devices  used  TSMC  0.18 pm  technology. 

Note  that  the  response  of  the  synapse  design  is  dependent  on  the  equivalent  re¬ 
sistance  of  the  transistor  Q  ( Rq ),  or,  the  size  of  Q.  This  can  also  be  demonstrated  in 
Fig.  9(b)  by  sweeping  the  width  of  Q  from  220 nm  to  4.4/im  with  a  step  of  220 nm. 
The  simulation  shows  that  a  larger  Q  can  result  in  a  wider  range  of  Vout  with  poorer 
linearity.  However,  for  a  large  Q,  the  enhancement  of  Vout  by  further  increasing  its 
size  is  marginal.  To  improve  design  stability,  a  buffer  can  be  added  at  output  of 
the  synapse  to  increase  voltage  swing.  Furthermore,  some  circuit  optimization  tech¬ 
niques,  such  as  asymmetry  gate  in  other  blocks,  can  be  used  to  minimize  the  overall 
synapse-based  system. 


6.2  Synapse  Training  Circuit 

Being  self-adaptive  to  the  environment  is  one  of  the  most  important  properties  of 
a  biological  synapse.  To  accomplish  the  similar  functionality,  a  training  block  is 
needed  in  the  memristor-based  synapse  that  can  adjust  its  memristance. 


6.2.1  Memristor  Training  Circuit 

Fig.  10(a)  shows  the  diagram  of  training  circuit  for  one  synapse  design,  based  on 
logic  analysis  and  simplification.  It  includes  two  major  components:  training  con¬ 
troller  and  write  driver.  By  comparing  the  current  synapse  output  Vout  and  the  ex¬ 
pected  output  Dtrai„,  training  controller  generates  the  control  signals.  The  write 
driver  uses  these  signals  to  control  two  pairs  of  NMOS  and  PMOS  switches  and 
supply  training  voltage  pair  Vtop  and  V/,„; .  The  training  pair  is  applied  to  the  two 
terminals  of  the  memristor  in  the  synapse  design. 
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(a) 


(b) 


Fig.  10  (a)  The  training  circuit  diagram,  (b)  The  proposed  synapse  together  with  training  circuit. 


Determined  by  the  training  enable  signal  E,  the  training  circuit  can  work  under 
two  modes. 

•  Operating  mode:  When  E  =  0,  the  synapse  is  under  regular  operating  (read) 
mode,  and  the  training  circuit  is  disabled. 

•  Training  mode:  The  training  circuit  is  enabled  when  E  =  1.  By  comparing  the 
current  synapse  output  Vout  and  the  expected  Dtraj„,  the  training  circuit  generates 
Vtop  and  Vbot  applied  to  the  two  terminals  of  memristor  to  update  or  keep  its 
memristance.  We  define  Vmem  =  Vtop  —  Vbot- 

Fig.  10(b)  depicts  the  proposed  memristor-based  synapse  integrated  with  train¬ 
ing  circuit.  An  extra  NMOS  transistor  £>2  is  inserted  in  synapse  to  isolate  training 
operation  from  other  voltage  sources:  when  E  =  1,  Qi  is  turned  off  so  that  the  two 
terminals  of  memristor  are  controlled  only  by  the  training  circuit,  not  affected  by 
Vin. 

The  timing  diagram  of  training  circuit  is  demonstrated  Fig.  1 1(a).  Before  a  train¬ 
ing  procedure  starts,  a  sensing  step  is  required  to  detect  the  current  Vout  to  be  com¬ 
pared  with  Dtmin-  In  the  sensing  phase,  accordingly,  training  enable  signal  E  is  set 
to  low  for  a  very  short  period  of  time  (e.g.,  4.5/z.v)  at  the  beginning  of  training.  At 


Operating  Training 

e  j  i  \nnrinrj 
Vo.’  xxx? — \  r~ 

iDon’tcarei _ i  i  i  i  i 

D,rain  XXX  \ _ j _ / 

V  J..FJ?.aLi!’.9.. 


Fig.  11  (a)  The  timing  diagram  of  training  circuit,  (b)  The  simulation  result  of  memristor  training. 
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Table  6  Sizing  of  INV \  and  Q\ 


P/N  Ratio 

PMOS/NMOS  in  INV 1 

Q 1 

2 

720nm/360nm 

1 8  x  220 nm 

2 

440nm/220nm 

1 6  x  220 nm 

1 

360nml360nm 

1 2  x  220 nm 

1 

220nm/220nm 

tlx  220 nm 

0.5 

360nm/120nm 

9  x  220 nm 

0.5 

220nm/440nm 

9  x  220 ran 

the  same  time,  (y'oul)  is  sent  to  Latch,  whose  output  (V'out)  remains  constant  during 
one  training  period,  as  shown  in  Fig.  10(a).  In  the  training  phase,  E  is  set  back  to 
high  for  a  much  longer  time  (i.e.,  5 1  ms)  to  change  the  memristance  if  needed. 

We  tested  the  training  procedure  by  using  the  T1O2  memristor  model  [2],  The 
training  circuit  was  designed  by  using  TSMC  0.18/im  technology  with  Vqd  =  1.8V. 
Changing  memristance  from  Rh  to  R/  or  verse  vice  takes  about  51ms.  The  simula¬ 
tion  result  is  shown  in  Fig.  1 1(b).  Here,  the  memristance  is  initialized  as  M  =  1 6KQ . 
In  the  first  51ms,  it  is  trained  to  1  K£2  by  setting  D,ram  to  low.  Then  at  t  =  51  ms,  we 
set  Dtrajn  to  high  and  train  the  memristance  back  to  Rh  in  the  following  51ms. 


6.2.2  Asymmetry  Gate  Design 


(a) 


(b) 


Fig.  12  (a)  Two-input  neuron  structure,  (b)  Training  sharing  distribution  circuit. 
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Table  7  Training  sharing  circuit  operation 


Status 

Vtopl 

Vbotl 

Vtopl 

Vbot2 

Training  M\ 

V,op 

Vbot 

Floating 

0 

Training  Mi 

Floating 

0 

V,op 

Vbo, 

Table  8  Synapse  input  pairs  for  different  logics 


Function  of  N 

Training  M\ 

Training  Mi 

OR/NOR 

XOR/XNOR 

AND/NAND 

Ai  =  1,A2  =  0 
Ai  =  1,A2  =0 
Ai  =  1,A2  =  1 

Ai  =0,A2  =  1 

Ai  =0,A2  =  1 
Ai  =  1,A2  =  1 

6.2.3  Multi-synapse  Training  Scheme 

Most  of  the  neuron  systems  are  constructed  by  multiple  synapses.  In  this  subsec¬ 
tion,  we  discuss  the  corresponding  training  scheme  by  taking  a  2-synapse  neuron  in 
Fig.  12(a)  as  the  example.  Here,  A  \  and  A2  are  two  synapse  inputs  received  from 
other  neurons.  M \  and  Mi  are  memristor-based  weights  for  two  synapses  .S’  1  and  Si. 
N  is  denoted  for  neuron  with  output  Vout.  The  value  of  Vou,  depends  on  the  func¬ 
tionality  of  N  as  well  as  Vouti  and  Vout2  from  the  two  synapses.  With  the  different 
combinations  of  A7 1  and  Mi-  the  two-input  neuron  could  obtain  different  function¬ 
ality. 

To  save  design  cost,  memristances  of  the  2-synapse  can  be  trained  separately  and 
share  one  training  circuit.  Fig.  12(b)  shows  a  training  sharing  distribution  circuit, 
which  generates  training  signals  to  control  M\  and  Mi.  The  training  sharing  circuit 
operations  under  different  conditions  are  shown  in  Table  7. 

The  two  synapse  inputs  A  \  and  Ai  can  be  used  to  determine  which  memristor,  M\ 
or  Mi,  is  in  training.  Table  8  lists  the  required  A 1  and  A2,  when  the  logic  functionality 
of  (V  is  one  of  the  following:  OR/NOR,  XOR/XNOR,  AND/NAND. 

Compared  to  the  separated  training  circuit  for  each  memristor,  the  shared  scheme 
can  reduce  26%  of  training  circuit  transistor  count.  More  saving  in  cost  and  area  can 
be  obtained  when  utilizing  this  training  sharing  distribution  scheme  to  multi-synapse 
structure  with  more  inputs. 


6.2.4  Self-Training  Mode 

To  improve  training  time  and  reduce  power  consumption,  we  introduce  the  concept 
of  self-training  in  our  design:  rather  than  using  a  fixed  long  training  period  (i.e., 
51  ms),  the  self-training  mode  automatically  stop  programming  memristor  whenever 
Vout  and  Dtrajn  become  same. 

The  proposed  training  circuit  supports  self-training  mode  by  dividing  a  long 
training  period  into  multiple  shorter  periods  and  detecting  Vou,  in  between.  The  pro¬ 
gramming  period  needs  to  be  carefully  selected:  if  it  is  too  short,  the  delay  and 
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Fig.  13  Self-training  simulation. 


energy  overheads  induced  by  Vout  detection  may  overwhelm  the  benefit  of  self¬ 
training.  On  the  contrary,  a  long  programming  period  cannot  show  enough  benefit. 

The  simulation  result  in  Fig.  13  shows  the  memristance  changing  when  sweeping 
programming  period  from  5.1ms  to  51ms  in  10  steps.  Obviously,  the  self-training 
mode  could  significantly  reduce  training  time.  In  theory,  the  proposed  training  cir¬ 
cuit  can  train  the  memristance  to  any  value  between  Rh  and  R/  .  The  real  training 
time  is  determined  by  the  specific  application  and  neuron  functionality. 


7  Conclusion 

In  this  work,  we  evaluate  the  impact  of  different  geometry  variations  on  the  elec¬ 
trical  properties  of  two  different  types  of  memristors,  Ti02-based  memristors  and 
spintronic  memristors,  by  conducting  analytic  modeling  analysis  and  Monte-Carlo 
simulations.  We  investigate  the  different  responses  of  the  static  and  memristive  pa¬ 
rameters  of  the  two  memristors  under  various  process  variations  and  analyze  their 
implication  for  the  electrical  properties  of  the  memristors.  A  simple  LER  sample 
generation  algorithm  is  also  proposed  to  speed  up  the  related  Monte-Carlo  simula¬ 
tions.  At  the  end,  we  propose  a  memristor-based  synapse  that  can  be  used  in  neu¬ 
romorphic  computing  architecture.  The  corresponding  training  operations  including 
multi-synapse  schemes  and  self-training  have  also  been  explored  and  discussed.  The 
proposed  synapse  design  can  be  generalized  to  other  memristor  materials  for  more 
applications. 
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